Reducing Frustration in Spin Systems: Social Balance as an XOR-SAT problem 
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Reduction of frustration was the driving force in an approach to social balance as it was recently 
considered by Antal et al. [ T. Antal, P. L. Krapivsky, and S. Redner , Phys. Rev. E 72 , 036121 
(2005). ]. We generalize their triad dynamics to fc-cycle dynamics for arbitrary integer fc. We derive 
the phase structure, determine the stationary solutions and calculate the time it takes to reach a 
frozen state. The main difference in the phase structure as a function of k is related to k being 
even or odd. As a second generalization we dilute the all-to-all coupling as considered by Antal 
et al. to a random network with connection probability w < 1. Interestingly, this model can be 
mapped onto a fc-XOR-SAT problem that is studied in connection with optimization problems in 
computer science. What is the phase of social balance in our original interpretation is the phase 
of satisfaction of all clauses without frustration in the satisfiability problem of computer science. 
Nevertheless, although the ideal solution without frustration always exists in the cases we study, 
it does not mean that it is ever reached, neither in the society nor in the optimization problem, 
because the local dynamical updating rules may be such that the ideal state is reached in a time that 
grows exponentially with the system size. We generalize the random local algorithm usually applied 
for solving the fc-XOR-SAT problem to a p-random local algorithm, including a parameter p, that 
corresponds to the propensity parameter in the social balance problem. The qualitative effect is a 
bias towards the optimal solution and a reduction of the needed simulation time. We establish the 
mapping between the fc-cycle dynamics for social balance on diluted networks and the fc-XOR-SAT 
problem solved by a p-random local algorithm. 
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I. INTRODUCTION 

Recently Antal et al. |l| proposed a triad dynamics to 
model the approach of social balance. An essential ingre- 
dient in the algorithm is the reduction of frustration in 
the following sense. To an edge (or link) in the all-to-all 
topology is assigned a value of +1 or —1 if it connects 
two individuals who are friends or enemies respectively. 
The sign ±1 of a link we call also its spin. If the prod- 
uct of links along the boundary of a triad is negative, 
the triad is called frustrated (or imbalanced), otherwise 
it is called balanced (or unfrustrated) . The state of the 
network is called balanced if all triads are balanced. If 
the balanced state is achieved by all links being positive 
the state is called "paradise". The algorithm depends 
on a parameter p £ [0,1] called propensity which deter- 
mines the tendency of the system to reduce frustration 
via nipping a negative link to a positive one with proba- 
bility p or via nipping a positive link to a negative with 
probability 1 — p. For an all-to-all topology Antal et al. 
predict a transition from imbalanced stationary states for 
p < 1/2 to balanced stationary states for p > 1/2. Here 
the dynamics is motivated by social applications so that 
the notion of frustration from physics goes along with 
frustration in the psychological sense. 
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Beyond frustration in social systems, within physics, the 
notion is familiar from spin glasses. It is the degree of 
frustration in spin glasses which determines the qualita- 
tive features of the energy landscape. A high [low] degree 
of frustration corresponds to many [few] local minima in 
the energy landscape. In terms of energy landscape it 
was speculated by Sasai and Wolynes Q that is the low 
degree of frustration in a genetic network which is respon- 
sible for the few stable cell states in the high-dimensional 
space of states. 

Calculational tools from spin-glass theory like the replica- 
method Q turned out to be quite useful in connection 
with generic optimization problems (as they occur, for 
example, in computer science) whenever there is a map 
between the spin-glass Hamiltonian and a cost func- 
tion. The goal in finding the ground state-energy of 
the Hamiltonian translates to the minimization of the 
costs. A particular class of the optimization problems 
refers to the satisfiability problems. More specifically one 
has a system of B Boolean variables and Q logical con- 
straints (clauses) between them. In this case, minimiz- 
ing the costs means minimizing the number of violated 
constraints. In case of the existence of a non-violating 
configuration the problem is said to be satisfiable, it has 
a zero-ground state energy in the Hamiltonian language. 
Here it is obvious that computer algorithms designed to 
find the optimal solution have to reduce the frustration 
down to a minimal value. So the reduction of frustration 
is in common to very different dynamical processes. 
The algorithms we have to deal with belong to the so- 
called incomplete algorithms 0- Q characterized by 
some kind of Monte-Carlo dynamics that tries to find 
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the solution via stochastic local moves in configuration 
space, starting from a random initial configuration. It ei- 
ther finds the solution "fast" or never (this will be made 
more precise below). Among the satisfiability problems 
there are the A:-SAT (kS) problems pll&lal, f° r which ac- 
tually no frustration-free solution exists above a certain 
threshold in the density of clauses imposed on the sys- 
tem. In this case the unsatisfiability is not a feature of the 
algorithm but intrinsic to the problem. However, there 
is a special case of fcS problems, so-called fc-XOR-SAT 
(fcXS) problems 0, H Q, E3 which are always solvable 
by some global algorithm, but poses a challenge for find- 
ing the solution by some kind of Monte-Carlo dynamics, 
very similar to the one used for solving the kS problem, 
where actually no solution may exist. Now it is these 
fcXS problems and their solutions that are related to the 
social balance dynamics. 

In particular it can be easily shown 0, EJ El that the 
satisfiability problem 3S (and also the subclass 3XS) can 
first be mapped onto a 3-spin model that is a spin-glass, 
and as we shall show below, the 3-spin glass model can 
next be mapped onto the triad dynamics of Antal et 
al. 0. The fcXS problem is usually studied for diluted 
connections because the interesting changes in the phase 
structure of the fcXS problem appear at certain threshold 
parameters in the dilution, while the all-to-all case is not 
of particular interest there. 

Dilution of the all-to-all topology is not only needed for 
the mapping to the 3XS problem in its usual form. It is 
also a natural generalization of the triad dynamics con- 
sidered in pj for social balance. A diluted network is 
more realistic than an all-to-all topology by two reasons: 
either two individuals may not know each other at all 
(this is very likely in case of a large population size) or 
they neither like or dislike each other, but are indiffer- 
ent as emphasized in [ll| as an argument for the postu- 
lated absence of links. For introducing dilution into the 
all-to-all network considered by Antal et al. it is quite 
natural to study random Erdos-Renyi networks |12( for 
which two nodes are connected by a link with probability 
w. On the other hand, dilution in the AXS problem is 
parameterized by the ratio a of number of clauses over 
number of variables (variables in the corresponding spin 
model or number of links in the triad dynamics) . We will 
determine the map between both parameterizations. 

In the first part of this paper (section [nj we generalize 
the triad dynamics to fc-cycle dynamics, driven by the 
reduction of frustration, with arbitrary integer k. In the 
context of social balance theory, Cartwright and Harary 
[Tl| introduced the notion of balance describing a bal- 
anced state with all fc-cycles being balanced and k not 
restricted to three. We first study such model on fully 
connected networks (section IIIIJ) . For given fixed and in- 
teger k > 3 in the updating rules, we draw the differential 
equations of the time evolution due to the local dynam- 
ics ( section |III Afl and we predict the stationary densities 
of fc-cycles, k arbitrary integer, containing j < k nega- 



tive links (section IIII Bfl . As long as k is odd (section 
1111 B If) in the updating dynamics, the results are only 
quantitatively different from the case of k — 3 considered 
in 0. An odd cycle of length three is, however, not an 
allowed loop in a bipartite graph, for which links may 
only exist between different type of vertices so that the 
length of a loop of minimal size in a bipartite graph is 
four. In addition, a 4-cycle with four negative links (that 
is four individuals each of which dislikes two others) is 
balanced and not frustrated, although it may be called 
the "hell" , so it does not need to be updated in order to 
reduce its frustration. (To call the hell with four negative 
links balanced is not specific for the notion of frustration 
in physics; also in social balance theory it is the product 
over links in the loop which counts and decides about 
balance or frustration |l3| .) This difference is essential 
as compared to the triad dynamics, in which a triad of 
three unfriendly links is always updated. It has impor- 
tant implications on the phase structure as we will show. 
For even values of k and larger than four, again there 
are only quantitative differences in the phase structure 
as compared to k = 4 (section IIII B 21) . 
As in ^1] , for odd values of k, we shall distinguish be- 
tween stationary states in the infinite volume limit that 
can be either balanced (for p > 1/2) or frustrated (for 
p < 1/2) since it is not possible to reach the paradise in 
a finite time. They are predicted as solutions of mean 
field equations. In numerical simulations, fluctuations 
about their stationary values do not die out in the phase 
for p < 1/2 so that some frustration remains, while for 
p > 1/2 frozen states are always reached in the form of 
the paradise although other balanced states with a finite 
amount of negative links are in principle available, but 
arc quite unlikely to be realized during the finite simu- 
lation time. They are exponentially suppressed due to 
their small weight in configuration space. We calculate 
the time it takes to reach a frozen state at and above 
the phase transition (section |III C 1(1 . For even values 
of k we have only two types of stationary frozen states, 
"paradise" and "hell" with all links being positive and 
negative, respectively. In this case the time to reach the 
frozen states at the transition can be calculated in two 
ways. The first possibility applies for both even and odd 
values of k and is based on calculating the time it takes 
until a fluctuation is of the same order in size as the 
average density of unfriendly links. The second one, ap- 
plicable to the case of even values of k, can be obtained 
by mapping the social system to a Markov process known 
as the Wright-Fisher model for diploid organisms [14| , for 
which the decay time to one of the final configurations 
(all "positive" or all "negative" genes) increases quadrat- 
ically in the size N of the system ( section IlII C 2() . 
In the second part we generalize the A:-cycle dynamics 
to diluted systems ( section ITvTl . The dilution, originally 
given in terms of the probability for connecting two links 
in a random Erdos-Renyi network 12] , is then parameter- 
ized in terms of the dilution parameter a, and the results 
for stationary and frozen states and the time needed to 
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reach them will be given as a function of a fsection riV All . 
The original triad dynamics of Antal et al. with propen- 
sity parameter p on a diluted network contains, as special 
case, the usual Random- Walk SAT (RWS) algorithm for 
finding the solution of the 3XS problem corresponding 
to the choice of p = 1/3 in the triad dynamics. There- 
fore it is natural to generalize the RWS algorithm for 
generic p £ [0, 1] and to study the modifications in the 
performance of the algorithm as a function of p (section 
II V til . For the kS problem, and similarly for the fcXS 
problem, there are three thresholds in a, ad, a s , and 
a c with ad < a s < a c . Roughly speaking, the thresh- 
old ad corresponds to a dynamical transition between a 
phase in which the RWS algorithm finds a solution in a 
time linearly increasing with the size of the system for 
a < ad, and exponentially increasing with the system 
size for a > ad- The value a s characterizes a transition 
in the structure of the solution space, from one cluster 
of exponentially many solutions (a < a s ) to exponen- 
tially many clusters of solutions (a > a s ). Finally, a c 
refers to the transition between satisfiable and unsat- 
isfiable fcS problems, this means that for these models 
not all constraints can be satisfied simultaneously in the 
UNSAT-phase for a > a c so that a finite amount of frus- 
tration remains. Above this last threshold lies a value of 
a, a = a m , such that for a > a m the mean field ap- 
proximation is justified that was used for the maximum 
value of a in the all-to-all topology of the triad dynamics 
of 0. We shall study the influence of the parameter p 
on the value of ad (section IIVB 1(1 and on the Hamming 
distance for a smaller a s or larger a s (section IIV B 21 . 
Moreover we will show how the choice of p changes the 
possibility to find a solution for the fcXS problem (section 
IIV B 3|) and we will determine the validity range of the 
mean- field approximation (section llVB 4(1 . As it turns 
out, the parameter p introduces some bias in the RWS, 
accelerating the convergence to "paradise" and reducing 
the explored part of configuration space. On the other 
hand, an inappropriate choice of p or too much dilution 
may prevent an approach to paradise. Fluctuations in the 
wrong direction, increasing the amount of frustration, go 
along with improved convergence to the balanced state. 



II. THE MODEL FOR SOCIAL BALANCE 

We represent individuals as vertices (or nodes) of a 
graph and a relationship between two individuals as a 
link (or edge) that connects the corresponding vertices. 
Moreover we assign to a link between two nodes i 
and j a binary spin variable s^j = ±1, with Sjj = 1 if 
the individuals i and j are friends , and Sij = —1 if i 
and j are enemies. We consider the standard notion of 
social balance extended to cycles of order k [ill Il5j . In 
particular a cycle of order k (or a fc-cycle) is defined as 
a closed path between k distinct nodes i\, %i, ■ .. , ik of 
the network, where the path is performed along the links 
of the network (ii,« 2 ) , (i2,h) , (ik-i,ik), 



Given a value of k we have k + 1 different types T , T\, 
. . . , Tj, . . . , Tfc of cycles of order k containing 0, 1, . . . , 
j, . . . , k negative links, respectively. A cycle of order k 
in the network is considered as balanced if the product 
of the signs of links along the cycle equals 1, otherwise 
the cycle is considered as imbalanced or frustrated. Ac- 
cordingly, the network is considered as balanced if each 
fc-cycle of the network is balanced. 

We consider our social network as a dynamical system. 
We perform a local unconstrained dynamics obtained by 
a natural generalization of the local triads dynamics, re- 
cently proposed by Antal et al. PJ . We first fix a value of 
k. Next, at each update we choose at random a /c-cycle 
Tj . If this /c-cycle Tj is balanced (j is even) nothing hap- 
pens. If Tj is imbalanced (j is odd) we change one of its 



link as follows: if j < k, then Tj 



Tj-i occurs with 



probability p, while Tj — > occurs with probability 

1 — p ; if j = k, then Tj — ► Tj-i happens with proba- 
bility 1. During one update, the positive [negative] link 
which we flip to take a negative [positive] sign is chosen at 
random between all the possible positive [negative] links 
belonging to the fc-cycle Tj. One unit of time is defined 
as a number of updates equal to L, where L total num- 
ber of links of the network. In Figure^we show a simple 
scheme that illustrates the dynamical rules in the case 
k = 4 (A) and k — 5 (B). It is evident from the figure 
that for even values of k the system remains the same if 



we simultaneously flip all the spins 
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and make the transformation p — > 1—p. The same is not 
true for odd values of k. The reason is that a /c-cycle with 
only "unfriendly" links is balanced for even values of k, 
while it is imbalanced for odd values of k. The presence 
or absence of this symmetry property for even values of 
k or odd, respectively, is responsible for very different 
features in the phase structure. This will be studied in 
detail in the following sections. 
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Figure 1: Dynamical rules in case of k = 4 (A) and k = 5 (B). 
The cycles containing an odd number of "unfriendly" links are 
considered as imbalanced and evolve into balanced ones. Full 
and dashed lines represent "friendly" and "unfriendly" links 
respectively. 



III. COMPLETE GRAPHS 

We first consider the case of fully connected networks. 
Later we extend the main results to the case of diluted 
networks in section llVl In a complete graph every indi- 
vidual has a relationship with everyone else. Let N be 
the number of nodes of this complete graph. The total 



number of links of the network is then given by L 
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while the total number of fc-cycles is given by M = (v) . 
(P is the standard notation of the binomial coefficient. 
It counts the total number of different ways of choosing y 
elements out of x elements in total, while it is < y < x 
, with x, y € N. Moreover we define Mj as the number of 
fc-cycles containing j negative links, and rrij — Mj/ M 
the respective density of fc-cycles of type Tj. The total 
number of positive links L + is then related to the number 
of fc-cycles by the relation 



Mi 



(N-2)\ j (JV-jfe)! 



(1) 



A similar relation holds for the total number of negative 
links L~ 



L~ = 



(N — 2)! / (N-k)\ 



(2) 



In particular, in Eq.s and (J2J) the numerators give us 
the total number of positive and negative links in all the 
/c-cycles, respectively, while the same denominator comes 
out from the fact that one link belongs to (N — 2) (N — 
3) • • • (N- k + 1) = (N - 2)!/ (N - fc)! different fc-cycles. 
Furthermore the density of positive links is p = L + / L = 

1 — 53i=o * m i ' while the density of negative links is 1 — p. 



A. Evolution Equations 

In view of deriving the mean field equations for the un- 
constrained dynamics, introduced in the former section 
ITTI we need to define the quantity Mj~ as the average 
number of fc-cycles of type Tj which are attached to a 
positive link. This number is given by 



Ml 



while similarly 



(fc-j) Mj 
L+ 



counts the average number of fc-cycles of type Tj attached 
to a negative link. In term of densities we can easily write 
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(k-j) mj 

Eto (*-<) 



and 



3 m j 



i=0 



(3) 



(4) 



Now let 7r + be the probability that a link flips its sign 
from positive to negative in one update event and 7r~ the 
probability that a negative link changes its sign to +1 in 
one update event. We can write such probabilities as 



(fe-l)/2 



= (1-P) 



m 2i 



(5) 



and 



(fe-l)/2 

P ^2 m 2«-i + m k 



(6) 



valid for the case odd values of k. For even values of k, 
these probabilities read 



k/2 
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and 



k/2 

P ^ ™2i-l 



(7) 



(8) 



Since each update changes (N — 2)!/ (N — k)\ fc-cycles, 
and also the number of updates in one time step is equal 
to L update events, the rate equations in the mean field 
approximation can be written as 
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7T TO 
7T 



mj 



(9) 
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— 7r m u 
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We remark that the only difference between the cases of 
odd values of fc and even values of fc comes from Eq.s 
and JBJ, and Eq.s @ and JSJ, respectively. This differ- 
ence is the main reason why the two cases odd values of fc 
and even values of fc lead to two completely different be- 
havior and why we treat them separately in the following 
section IIII Bl 



B. Stationary states 

Next let us derive the stationary states from the rate 
equations I© that give a proper description of the uncon- 
strained dynamics of fc-cycles in a complete graph. Im- 
posing the stationary condition 4z mj = ,V0<j < k, 
we easily obtain 
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, V I < j < k 



(10) 



Then, forming products of the former quantities appear- 
ing in Ea. HIU|) . we have 



V I < j < k 
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and, using the definitions of Eq.s © and we finally 
obtain 

(k - j + 1) (j + 1) rrij-i m i+ i = (k-j)j(rrij) , 

(11) 

valid V 1 < j < /c. Moreover the normalization condition 
J2i m i = 1 should be satisfied. Furthermore, in the 
case of stationary, the density of friendships should be 
fixed, so that we should impose that tt + = n~ . 



1. The case of odd values of k 

In the case of odd values of k, the condition for having 
a fixed density of friendships reads 



m k 



(1 



(k-l)/2 
2p) ^ m 2i 



(12) 



where we used Eq.s (JSJ and (|SJ|. In principle the k equa- 
tions of {TJ plus the normalization condition and the 
fixed friendship relation (|12J) determine the stationary 
solution. For k = 3 Antal et al. Q found 



Q pV (1 - Poo) 3 , V < j < 3 



where 




,ifp<l/2 
,ifp>l/2 



(13) 



(14) 



is the stationary density of friendly links. In the same 
manner also the case k = 5 can be solved exactly with 
the solution 



o*-i (1-PooY , V0<j<5 



(15) 



where 



\ 



5(1 




(16) 

for p < 1/2, while p x = 1 for p > 1/2. 
In Figure |3 we plot the densities mj given by Eq. I|15|) 
and the stationary density of friendly links p^, given by 
Ea. (|16[) as function of p. Moreover we verified the validity 
of the solution performing several numerical simulations 
on a complete graph with N = 64 nodes (full dots). We 
compute numerically the average density of positive links 
after 10 3 time steps, where the average is done over 10 2 
different realizations of the system. At the beginning of 
each realization we select at random the values of the 
signs of the links, where each of them has the same prob- 
ability to be positive or negative, so that pa = 0.5. The 
numerical results perfectly reproduce our analytical pre- 
dictions. 




Figure 2: (Color online) Exact stationary densities rrij for 
the cycles of order k = 5 from Eg. 1151 and stationary density 
of friendly links poo from Ea. lltjlL both as a function of the 
dynamical parameter p. Numerical results are also reported 
for a system with N — 64 vertices. Each value (full dot) is 
obtained by averaging the density of friendly links reached af- 
ter 10 3 time steps over 10 2 different realizations with random 
initial conditions (po = 0.5). 



As one can easily see, both solutions (|13|) and (|15fl are 
just binomial distributions. This means that the densi- 
ties of a cycle of order k = 3 or a cycle of order k = 5 
with j negative links are simply given by the probability 
of finding these densities on a complete graph in which 
each link is set equal to 1 with probability poo or equal 
to —1 with probability 1 — p^. (As already noticed in 
[l|, this result may come a bit as a surprise, because the 
3-cycle or here the 5-cycle dynamics seems to be biased 
towards the reduction of frustration, on the other hand 
it is a bias for individual triads without any constraint 
of the type that the frustration of the whole "society" 
should get reduced.) 

For odd values of k > 5, a stationary solution always ex- 
ists. This solution becomes harder to find as k increases, 
because the maximal order of the polynomials involved 
increases with k (for k = 3 we have polynomials of first 
order, for k — 5 polynomials of second order, for k — 7 
of third and so on). So it becomes impossible to find 
the solution analytically as the maximal order of solv- 
able equations is reached. Nevertheless we can give an 
approximate solution using a self-consistent approach as 
we shall outline in the following. We suppose that the 
general solution for the stationary densities is of the form 



k ~i (1 - PooY , V < j < k 



(17) 



Eq. (|17|) is an appropriate ansatz as we can directly see 
from the definition of the density of friendly links p^ — 
1 — 2j = o i Trii = 1 — (1 — Poo), where the last term comes 
out as mean value of the binomial distribution. ( Ac- 
tually such self-consistency condition is satisfied by any 
distribution of the rrijS with mean value equal to 1 — p^. 
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) Moreover the ansatz for the stationary solution in the 
form of Ea. (|17H has the following features: first it is valid 
for the special cases k = 3 and k = 5, and second, it is nu- 
merically supported. In Figure |3| we show some results 
obtained by numerical simulations. We plot the densi- 
ties rrij for different values of k [ k = 7 (A) , k = 9 (B), 
k = 11 (C) and k — 21 (D) ] and different values of p [ 
p = (black circles) , p = 0.3 (red squares) , p = 0.44 
(green diamonds) and p = 0.49 (blue crosses) ]. We per- 
formed 50 different realizations of a system of N = 64 
vertices, where the densities are extrapolated from 10 6 
samples (/c-cycles) at each realization and after 5 • 10 2 
time steps of the simulations (so that we have reached 
the stationary state). The initial values of the signs are 
chosen to be friendly or unfriendly with the same prob- 
ability (p = 0.5). The full lines are given by Ea. i(T7|) 
for which the right value of poa is given by the average 
stationary density of friendly links and the average is 
performed over all simulations. Furthermore, we numer- 
ically check whether Eq. l|17|l holds, with the same p,^ if 
we measure the densities of cycles also of order k' ^ k 
and moreover, whether it holds during the time while 
using the time dependent density of friendly links p(t) 
instead of the stationary one poa . Since all these checks 
are positive, we may say that if at some time the distri- 
bution of friendly links (and consequently of unfriendly 
links) is uncorrelated, it will stay so forever. 




10 15 20 



Figure 3: (Color online) Stationary densities rrij for the k- 
cycles with j negative links and different values of k [ k — 7 
(A) , k = 9 (B), k = 11 (C) and k = 21 (D) ], and for differ- 
ent values of p [ p — (black circles) , p — 0.3 (red squares) , 
p — 0.44 (green diamonds) and p — 0.49 (blue crosses) ]. The 
numerical results (symbols) represent the histograms extrap- 
olated from 10 6 samples and over 50 different realizations of 
the network. In particular the initial values of the spins are 
equally likely at each realization (so that po = 0.5), the dis- 
tributions are sampled after 5 • 10 2 time steps and the system 
size is always N = 64. The prediction of Eg. 1171 is plotted as 
a full line and the value of p x used is taken from the simula- 
tions as the average value of the stationary density of positive 
links. 

Let us assume that the ansatz (II 71) is valid, we then eval- 



uate the unknown value of p^ self-consistently by im- 
posing the condition that the density of friendly links is 
fixed at the stationary state 



(fc-l)/2 

r+ = 7T~ & (1 - 2p) TO 2*-1 

i=l 



m k 



In particular we can write 

(fc-l)/2 (fc+l)/2 

^ m 2 i-i + m k = ^ m 2i-i = £ , (18) 

i=l i=l 

and so 



m k 



(1 - 2p) (£ - m k ) 



from which 



= 1 



g(l-2p) 
2(l-p) 



l/fc 



(19) 



for p < 1/2, while poo = 1 for p > 1/2. In particular we 
notice that Ea. l|19f) goes to zero as k — > oo for p < 1/2, 
because < £ < 1.. This means that in the limit of large 
k the stationary density of friendly links takes the typ- 
ical shape of a step function centered at p = 1/2, with 
Poo = for p < 1/2 and p^ — 1 for p > 1/2. This is ex- 
actly the result we find for the case even values of k (see 
the next section IlII B 2|) . and it is easily explained since 
in the limit of large k the distinction between the cases 
odd values of k and k even should become irrelevant. 
Furthermore it should be noticed that £ defined in 
Eq. (ll8|) is nothing more than a sum of all odd terms of 
a binomial distribution. For large values of k we should 
expect that the sum of the odd terms is equal to the sum 
of the even terms of the distribution, so that 



(fc+l)/2 



(fc-l)/2 

E 

i=0 



I2j 



because of the normalization. In Figure 0] we plot the 
quantity (1 — Poo) k obtained by numerical simulations 
for different values of k [ A; = 3 (black circles) , k = 5 
(red squares) , k — 7 (blue diamonds) , k = 9 (violet 
triangles), k = 11 (orange crosses) ] as a function of p. 
Each point represents the average value of the density of 
positive links (after 10 3 time steps) over 10 2 different re- 
alizations. The system size in our simulations is N = 64, 
while, at the beginning of each realization, the links have 
the same probability to have positive or negative spin 
(po = 0.5). From Eq. l|19|) we expect that the numerical 
results collapse on the same curve £(1 — 2p)/(2 — 2p), de- 
pending on the parameter £. Imposing £ — 1/2 [dashed 
line] we obtain an excellent fit for all values of p. Only for 
small values of p the fit is less good than for intermediate 
and large values of p, which is explained by the plot in the 
inset of Figure^] There Eq. i|18|) is shown as function of p 
for k — 3 (black dotted line) and for k = 5 (red full line). 
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The values of rrij are taken directly from the binomial 
distribution of Eq. (|17|l with values of p^ known exactly 
from Eq.s (jl4|) and (|16fl for k — 3 and k = 5, respectively. 
We can see how well the approximation £ = 1/2 works 
already for k — 3 and how it improves for k — 5, with 
the only exception for small values of p where £ > 1/2. 
Furthermore we see that £ < 1/2 for p ~ 1/2, but in this 
range the dependence on £ of Ea. (|19fl becomes weaker 
since the factor £(1 — 2p) tends to zero anyway. 
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Figure 4: (Color online) Numerical results (symbols) and ap- 
proximate solution (dashed line) for the function (1 — poo) k , 
depending on the stationary density of positive links p x and 
the parameter k [ k = 3 (black circles) , k = 5 (red squares) , 
k — 7 (blue diamonds) , k = 9 (violet triangles) , k = 11 (or- 
ange crosses) ], as a function of the dynamical parameter p. 
The theoretical result, plotted here as a dashed line, is given 
by Eq.lEnj for £ = 1/2. This prediction is in good agreement 
with the numerical results obtained by averaging the density 
of friendly links after 10 3 time steps over 10 2 different real- 
izations. The system size is iV = 64. Each simulation starts 
with random initial conditions (po = 0.5). Moreover, as we 
can see from the inset, the value of £ calculated for k = 3 (red 
full line) and for k — 5 (black dotted line) is very close to 1/2 
for an extended range of p. 



prevents the system from reaching the "hell", that is a 
state of only negative links, because here a completely 
negative cycle is stable. Only for p = 1/2 we expect 
to find a non-frozen fluctuating final state, since in this 
case the elementary dynamical processes are fully sym- 
metric. Imposing the stationary conditions on the system 
we do not get detailed information about the final state. 
As we can see from Eq.s {7J and (JHJ, for p ^ 1/2 the 
only possibility to have 7r + = 7r~ is the trivial solution 
for which both probabilities are equal to zero, so that 
the system must reach a frozen configuration, while for 
p = 1/2, 7r + and 7r~ are always equal, in this case we 
expect the system to reach immediately an active steady 
state. In order to describe more precisely the final con- 
figuration of this active steady state, it is instructive to 
consider the mean-field equation for the density of pos- 
itive links. For generic even value of fc, it is easy to see 
that the number of positive links increases in updates of 



type T 2j . 



! 2(i-i) 



with probability p, whereas it de- 



creases in updates of type T 2 j-\ — * T 2 j with probability 
1 — p, so that the mean field equation that governs the 
behavior of the density of friendly links is given by 



§ = (2p-l)p(l-p)-2 

z=l 



k 

2i-l 



, p k-2 iri _ f)) 2{i-l) 



(20) 

For p ^ 1/2 we have only two stationary states, poc = 
and poo = 1 (the other roots of the steady state equation 
are complex). It is easily understood that for p < 1/2 
the stable configuration is p^ = 0, while for p > 1/2 it 
is Poo = 1- In contrast, for p — 1/2 we have p(t) =const 
at any time, so that p^ = p{t = 0) = po- These results 
are confirmed by numerical simulations. Moreover, the 
convergence to the thermodynamical limit is quite fast, 
as it can be seen in Figure^ where we plot the density of 
friendly links poo as a function of p for the system sizes N 
[ N = 8 (dotted line), N = 16 (dashed line) and N = 32 
(full line) ] and for k — 4. Each curve is obtained from 
averages over 10 3 different realizations of the dynamical 
system. In all simulations the links get initially assigned 
the values ±1 with equal probability, so that po = 0.5. 



2. The case of even values of k 

The stability of a fc-cycle with all negative links in the 
case of even k (see Figure^ has deep implications on the 
global behavior of the model. Actually the elementary 
dynamics is now symmetric. Only the value of p gives 
a preferential direction (towards a completely friendly or 
unfriendly cycle) to the basic processes. With odd k, for 
p < 1/2 the tendency of the dynamics to reach the state 
with a minor number of positive links in the elementary 
processes (involving no totally unfriendly cycles) is over- 
balanced by the process Tfc — > T^-i which happens with 
probability one, so that in the thermodynamical limit 
the system ends up in an active steady state with a finite 
average density of negative links due to the competition 
between the basic processes. Instead, for even k, nothing 



C. Frozen configurations 

When all fc-cycles of the network are balanced we say 
that the network itself is balanced. In particular, in the 
case of our unconstrained dynamics we can say that if 
the network is balanced it has reached a frozen config- 
uration. The configuration is frozen in the sense that 
no dynamics is left since the system cannot esca pe a bal- 
anced configuration. Furthermore it was proven 111 that 
if a graph (not only a complete graph) is balanced it is 
balanced independently of the choice of k and that the 
only possible balanced configurations are given by bipar- 
titions of the network in two subgroups (or "cliques" ) , 
where all the individuals belonging to the same subgroup 
are friends while every couple of individuals belonging to 
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Figure 5: Behavior of the stationary density of friendly links 
Poo as a function of p for three (small) values of N [ N = 8 
(dotted line), 16 (dashed line) and 32 (full line) ] and for k = 4. 
The values of the initial configuration are randomly chosen to 
be ±1 with density of friendly links po — 0.5. The curves are 
obtained from averages over 10 3 different realizations. 



different subgroups are enemies (this result is also known 
as Structure Theorem |13|). In the case of even values of 
k the latter result is still valid if all the individuals of one 
subgroup are enemies, while two individuals belonging 
to different subgroups are friends. It should be noticed 
that one of the two cliques may be empty and therefore 
the configuration of the paradise (where all the individ- 
uals are friends) is also included in this result, as well 
as, for the case even values of k, the hell with all indi- 
viduals being enemies . In the following we will combine 
our former results about the stationary states (section 
IIII Bll with the notion of frozen configurations in order to 
predict the probability of finding a particular balanced 
configuration and the time needed for freezing our un- 
constrained dynamical process. For clarity we analyze 
the cases of odd values of k and even values of k sepa- 
rately, again. 



1. Freezing time for odd values of k 

Let < iVi < N be the size of one of the two cliques. 
Therefore the other clique will be of size N — Ni . In such 
a frozen configuration the total number of positive and 
negative links are related to iVi and 7Y by 



L+ = 



N-l(N-l-1) (N - Ni)(N - Ni-1) 



+ 



and 



TYi (N-Nx) 



(21) 



(22) 



respectively. As we have seen in the former section 
HUB II for odd values of k and p < 1/2, all the k- 
cycles are uncorrelated during the unconstrained dynam- 
ical evolution, if we start from an initially uncorrelated 



P 



configuration. In such cases, we can consider our system 
as a purely random process in which the values of the 
spins are chosen at random with a certain probability. 
In particular, the probability of a link to be positive is 
given by p , the density of positive links ( 1 — p is the 
probability for a link to be negative). The probability 
of reaching a frozen configuration, characterized by two 
cliques of iVi nodes and TV — N\ nodes, is then given by 

'N s 

(23) 

The binomial coefficient (^) in Eg. (I23fl counts the total 
number of possible bi-partitions into cliques with /Vi and 
N — N\ nodes ( i.e. the total number of different ways 
for choosing Ni nodes out of N), and each of these bi- 
partitions is considered as equally likely because of the 
randomness of the process. We should also remark that 
in Eq.(|23J) we omit the time dependence of p, while the 
density of positive links p follows the following master- 
equation 



, (*-l)/2 
i=l 



k 

2i- 1 



L (l-P) 



fc-2i+l 



Ea. (|23|) shows that the probability of having a frozen 
configuration with cliques of Ni and N — Ni nodes is ex- 
tremely small, because the number of the other equiprob- 
able configurations with the same number of negative and 
positive links is equal to ( L L _) ^> Q^), where L~ should 
satisfy Ea. (|22|l . This allows us to ignore the transient 
time to reach the stationary state (we expect that the 
system goes to the stationary state exponentially fast for 
any k, as shown in 1] for k = 3) and consider the prob- 
ability for obtaining a frozen configurations as 



P(Poo) 



N 
Ni=0 



,JVi) 



(24) 



This probability provides a good estimate for the order 
of magnitude in time r that is needed to reach a frozen 
configuration, because r ~ 1/P(p 00 ). Unfortunately this 
estimate reveals that the time needed for freezing the sys- 
tem becomes very large already for small sizes TV (i.e. r 
increases almost exponentially as a function of L ~ TV 2 ). 
This means that it is practically impossible to verify this 
estimate in numerical simulations. 

At the transition, for the dynamical parameter p = 1/2 
we can follow the same procedure as used by Antal et 
al. . The procedure is based on calculating the time it 
takes until a fluctuation in the number of negative links 
reaches the same order of magnitude as the average num- 
ber of negative links. In this case the systems happens 
to reach the frozen configuration of the paradise due to 
a fluctuation. The number of unfriendly links L~ = A(t) 
can be written in the canonical form [16| 



A(t) = La(t) + \fZr){t) 



(25) 
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where a(t) is the deterministic part and 77(f) is a stochas- 
tic variable such that (rf) — 0. Let us consider the ele- 
mentary processes 

{A - I , rate M k 
A-l ,rate p££i 1)/2 m ^-i 
A+l ,rate (1 - p) E& 1)/2 ^2i-i 

(26) 

and therefore 

{A 2 -2A+ 1 , rate M fe 
A 2 -2A+1 .rate f>E£7 1)/2 M 2i _! 
A 2 + 2A+1 , rate (1 - p) Ei=7 1)/2 

We can then write the following equations for the mean 
values of A and ^4 2 



It is easy to see that (i]M k ) ~ (r/yl' c ) = (r)(La + \/Lr]) k ), 
so that 

{r]M k } ~ (tj • (L fc a fc + kL k - 1 / 2 a k - 1 i] + . . . + L k ^ 2 rj k )) = 
= kL k - 1 / 2 a k - 1 (rf)+0((rf)) . 

(32) 

Dividing Ea.ipfl|) by Eq.® and using Ea. l32[) we get 



r/o" 



(fc+l)/2 



2ka k - 1 a- J2 



k 

2i-l 



k-2i+l 



Here we have taken into account that 



(33) 



(34) 



It is straightforward to find the solution of Eq. I|33l) as 



rf(A) 



(fc-l)/2 



= -<M fc ) + (l-2p) ( M 2«-i> 



<r(o) = Ca 2k + ^ 



7o 

,fc-2 



and 



with C and 7j suitable constants. From Ea. (|30(l . for t 
00 we have 



^1= ((l-2A)M k ) + 



For p — 1/2 we obtain 

d(A) 



- P ((1-2A)E£T 1)/2m 2^i 
-(l-2p)((l+2A)E£j 1)/2 M 2i _ 1 



■(M fe ) 



cff 



(28) 



and 



ri(A 2 



(fc-l)/2 



= <M fe )+ 2 (M 2i _ 1 )-2{AM k 



a ~ a-( fc - 2 ) . 

For 7/ ~ y^cr, we finally obtain 

fc— 2 

77 ~ i2(fc-D 



In general, the system will reach the frozen state of the 
paradise when the fluctuations of the number of negative 
links become of the same order as its mean value. (Note 
that in this case the mean-field approach is no longer 
valid.) Then, in order of finding the freezing time r we 
have just to set equal the two terms on the right hand 
side of Eq.® 



La(r) ~ VLt]{t) 



Since it is (A) ~ a and (M k ) ~ a fc , we get from Eq.® Since L ~ TV 2 , we get a power-law behavior 



from which 



da 
lit 



a(t) ~ t~— 



(29) 



(30) 



with exponent f3 as a function of k according to 







fc- 1 



(35) 



(36) 



(37) 



On the other hand, considering that d(A) 2 /dt = 2(A) ■ 
d(A)/dt and by definition a = (A 2 ) - (A) 2 = (tj 2 ), we 
have 



da 



(fe-l)/2 



— = (M k )+ J2 (M 2t -i)-2((AM k )-(A)(M k )) 



Moreover we can write 



(31) 



(AM k ) - (A) (M k ) = ((La + VLr))M k ) - La(M k ) = 
fL{r)M k ) 



It is worth noticing that in the limit fc — > 00 we obtain 
P = 2, which is the same result as in the case of even 
values of fc as we shall see soon. The analytical results 
of this subsection are well confirmed by simulations, cf. 
FigureEJ There we study numerically the freezing time r 
as a function of the system size N for different odd values 
of fc [ fc = 3 (black circles) , fc = 5 (red squares) , fc = 7 
(blue diamonds) , fc = 9 (violet triangles) and fc = 15 
(orange crosses) ]. The freezing time is measured until 
all links have positive sign and paradise is reached. Other 
frozen configurations are too unlikely to be realized. Each 
point stands for the average value over a different number 



10 




128 256 512 1024 
N 



update events E ~ M/R until the paradise is reached, 
which leads to a freezing time r ~ E/L, with L the total 
number of links independent on k, so that 



1 



(39) 



For values ofl/2<p<l the fc-dependence of r should 
be weaker than the one in Ea. (|39fl . but anyway t should 
be a decreasing function of k. The inset of Figure El 
shows the numerical results obtained for p = 3/4 as a 
function of the size of the system N. The freezing time r 
is measured for different values of k. We plot the average 
value over 10 3 different realizations with initial condition 
Po = 0. 



Figure 6: (Color online) Numerical results (full dots) for the 
freezing time r as a function of the system size N and for 
various k [ k = 3 (black circles) , k = 5 (red squares) , k = 7 
(blue diamonds) , k — 9 (violet triangles) and k = 15 (or- 
ange crosses) ] . Each point is given by the average value over 
several realizations [ 100 realizations for sizes N < 64 , 50 re- 
alizations for 64 < N < 256 and 10 realizations for TV > 256 ] . 
Moreover as initial configuration of each realization the links 
are chosen all negative (po = 0, antagonistic society) in order 
to reduce the statistical error (the standard deviation is com- 
parable with the symbol size) caused by the small number of 
realizations at larger sizes of the system. The full lines have 
slope 2(k — l)/k as expected from Ea. l)37^ . The inset shows 
the numerical results for the freezing time r , for different 
values of k (the same as in the main plot), as a function of 
the system size TV and for p — 3/4. Each point of the inset is 
given by the average over 10 3 different realizations with initial 
antagonistic society. 

of realizations of the dynamical system [ 100 realizations 
for sizes N < 64 , 50 realizations for 64 < N < 256 and 10 
realizations for N > 256 ] , where the initial configuration 
is always chosen as an antagonistic society (all the links 
being negative so that po = 0) to reduce the statistical 
error. The standard deviations around the averages have 
sizes comparable with the symbol sizes. The full lines 
stands for power laws with exponents given by Ea. (|3T|l . 
They perfectly fit with the numerical measurements. 



For p > 1/2 the freezing time r scales as 

r-lniV . (38) 

The derivation would be the same as in the paper of 
Antal et al. Q. It should be noticed that for p > 1/2 the 
paradise is reached as soon as k increases. For simplicity 
let p = 1 and imagine that the system is at the closest 
configuration to the paradise, for which only one link 
in the system has negative spin. This link belongs to 
R = (N-2)\/(N- k)\ different A;-cycles. At each update 
event we select one fc-cycle at random out of M = ( k ) 
total fc-cycles. This way we have to wait a number of 



2. Freezing time for even values of k 

In the case of even values of k and p =1/2 the master 
equation for the density of positive links [ Eq. H20|) ] reads 
as dp/dt = 0. Therefore, the density of friendly links, 
p, should be constant during time for an infinite large 
system. In finite size systems the dynamics is subjected 
to non-negligible fluctuations. This allows to understand 
the scaling features of the freezing time r with the system 
size. The order of the fluctuations is \[L because the 
process is completely random as we have seen for the 
case odd values of k and p < 1/2. Differently from the 
latter case, for even values of k and p = 1/2 the system 
has no tendency to go to a fixed point determined by p 
because dp/dt = 0. We can view the dynamical system 
as a Markov chain, with discrete steps in time and state 
space, for which the transition probability for passing 
from a state with L~(t — 1) negative at time t — 1 to a 
state with L~(t) negative links at time t is given by 

P[L-(t)\L-(t-l)} = 

(40) 

So that the probability of having L (t) negative links 
at time t is just a binomial distribution where the prob- 
ability of having one negative link is given by L ^ , 
the density of negative links at time t — 1. This in- 
cludes both the randomness of the displacement of neg- 
ative links and the absence of a particular fixed point 
dependent on p. The Markov process, with transition 
probability given by Eq. <|40|l , is known under the name 
of the Wright-Fisher model 14] from the context of bi- 
ology. The Wright-Fisher model is a simple stochastic 
model for the reproduction of diploid organisms (diploid 
means that each organism has two genes, here named as 
"— " and "+"), it was proposed independently by R.A. 
Fisher and S. Wright at the beginning of the thirties [T^ . 
The population size of genes in an organism is fixed and 
equal to L/2 so that the total number of genes is L. 
Each organism lives only for one generation and dies af- 
ter the offsprings are made. Each offspring receives two 



11 



genes, each one selected with probability 1/2 out of the 
two genes of a parent of which two are randomly selected 
from the population of the former generation. Now let 
us assume that there is a random initial configuration 
of positive and negative genes with a slight surplus of 
negative genes. The offspring generation selects its genes 
randomly from this pool and provides the pool for the 
next offspring generation. Since the pools get never re- 
freshed by a new random configuration, the initial surplus 
of negative links gets amplified in each offspring gener- 
ation until the whole population of genes is " negative" . 
Actually the solution of the Wright-Fisher model is quite 
simple. The process always converges to a final state with 
L~ = [L + = L] or L~ = L [L + = 0], corresponding 
to our heaven and [hell] solutions for even values of k. 
The average value over several realizations of the same 
process depends on the initial density of friendly links pa 
according to 

(L-) = Po 6(0) + (1 - po)S(L) , 

where S(x) — 1 for x = and S(x) = otherwise. Fur- 
thermore, on average, the number of negative links de- 
cays exponentially fast to one of the two extremal values 



(L"(t))~L 



with typical decay time 



-t/L 



-t/L 



T ~ L ~ N z 



(41) 



This result is perfectly reproduced by the numerical data 
plotted in Figure [7| The main plot shows the average 
time needed to reach a balanced configuration as a func- 
tion of the size of the system TV and for different val- 
ues of k [ k = 4 (black circles) , k = 6 (red squares) 
, k = 8 (blue diamonds) and k = 12 (violet crosses) ]. 
The averages are performed over different numbers of re- 
alizations depending on the size TV [ 1000 realizations for 
sizes TV < 128 , 500 realizations for 128 < TV < 384 and 
50 realizations for TV = 384 and TV — 512, and 10 re- 
alizations for TV — 1024 ]. The dashed line in Figure [7| 
has, in the log-log plane, a slope equal to 2, all numerical 
data fit very well with this line. Furthermore it should 
be noticed that there is no A-dependence of the freezing 
time t, as it is described by Eq.|@DJ. This is reflected by 
the fact that r is the same for all the values of k consid- 
ered in the numerical measurements. Nevertheless there 
is a difference between our model and the Wright-Fisher 
model that should be noticed. During the evolution of 
our model there is the possibility that the system freezes 
in a configuration different from the paradise ( L~ = 
) or the hell (L~ = L ). The probability of this event 
is still given by Ea.l(25|l. with r = L + {N{)/L as the sta- 
tionary condition [ L + (Ni) is given by Ea. (|21() ]. In this 
way Ea. l|23|l gives us P(Ni), the not-normalized proba- 
bility for the system to freeze in a balanced configuration 
with two cliques of N% and TV — Ni nodes, respectively. 
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Figure 7: (Color online) Numerical results for the freezing 
time t as a function of the system size TV and for various even 
values of k [ k — 4 (black circles) , k = 6 (red squares) , k = 8 
(blue diamonds) and k = 12 (violet crosses) ] and for p = 1/2. 
Each point is given by the average value over several realiza- 
tions [ 100 realizations for sizes JV < 64 , 50 realizations for 
64 < N < 256 and 10 realizations for N > 256 ]. Moreover, 
at the beginning of each realization the links are chosen to 
be positive or negative with the same probability (po = 0.5). 
The dashed line has, in the log-log plane, slope 2 as expected 
in Eg. 14111 . The inset A) shows the numerical results for the 
freezing time r , for different values of k (the same as in the 
main plot), as a function of the system size N and for p = 3/4. 
Each point of the inset is given by the average over 10 3 dif- 
ferent realizations with random initial conditions. The full 
lines are all proportional to IniV as expected. The inset B) 
shows the not-normalized probability P(Ni) as a function of 
the ratio Ni/N and for different values of the system size 
[ TV = 6 (full line), N = 8 (dashed line) and N = 10 (dotted 
line) ]. As one can see, P(N\) is extremely small for values 
of < Nl < N already for N = 10. 



It is straightforward to see that P(Ni) = 1 for Ni = 
or for Ni = N, so that the paradise has a non- vanishing 
probability to be a frozen configuration. Differently for 
any other value of < Ni < N, P(Ni) decreases to zero 
faster than 1/N. This means that for values of N large 
enough it is appropriate to forget about the intermedi- 
ate frozen configurations and to consider the features of 
our model as being very well approximated by those of 
the Wright-Fisher model. In the inset B) of Figure [7| 
the function P(N\) is plotted for different values of N [ 
N = 6 (full line), N = 8 (dashed line) and N = 10 (dot- 
ted line) ] with Ni a continuous variable for clarity of the 
figure (we approximate the factorial with the Stirling's 
formula). Obviously P(N\) disappears for < Ni < N 
as N increases, already for reasonably small values of TV. 
The dependence r ~ TV 2 can also be obtained using the 
same procedure as the one in section UlI C II for the case 
odd values of k and p = 1/2. In particular for even values 
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of k we can rewrite Eq. (|26|l according to 

^ > i A—l , rate p^-il Af 2i _i 

\ A + 1 , rate (1 - p) Mjm-i 

and therefore Eq. (|2*7|) according to 



(42) 



A 2 



A 2 -2A+\ , rate p£i=?-M2i-i 

A 2 + 2A+1 .rate (1 - p) Eiii M 2i-i 



For p=l/2we have 



<*(A) 



(43) 
(44) 



and 



d(A 2 ) 
dt 



k/2 



Ea. (|l^|l tells us that a ~ (A) =const, so that we have 

remebering Ea.Q34[l. As in the previous case, for deter- 
mining the freezing time we impose the condition that 
the average value is of the same order as the fluctuations 
[Eq.JSHJ)], and, for L ~ TV 2 , we obtain again EcL lfld*]) . 

For even values of k and for p ^ 1/2 the time r needed 
for reaching a frozen configuration scales asr~ In TV. In 
the inset of Figure [7| numerical estimates of t for p = 3/4 
and different values of k demonstrate this dependence on 
the size N of the system. Each point is obtained from 
averaging over 10 3 different simulations with the same 
initial conditions po — 0.5. Again, as in the case of k odd 
and p > 1/2, r is a decreasing function of k and the same 
argument used for obtaining Ea. l|39|l can be applied here. 

IV. DILUTED NETWORKS 

In this section we extend the former results, valid in 
the case of fully connected networks, to diluted networks. 
Real networks, apart from very small ones, cannot be rep- 
resented by complete graphs. The situation in which all 
individuals know each other is in practice very unlikely. 
As mentioned in the introduction, links may be also miss- 
ing, because individuals neither like nor dislike each other 
but are just indifferent. In the following we analyze the 
features of dynamical systems, still following the uncon- 
strained /c-cycle dynamics, but living on topologies given 
by diluted networks. 

For diluted networks there is an interesting connection to 
another set of problems that leads to a new interpretation 
of the social balance problem in terms of a certain fc-S AT 
(kS) problems (SAT stands for satisfiability) 0,HH. In 



such a problem a formula F consists of Q logical clauses 
{Cq] q=l q which are defined over a set of B Boolean 
variables {x t = 0, l} i=1 B which can take two possible 
values =FALSE or 1 = TRUE. Every clause contains 
k randomly chosen Boolean variables that are connected 
by logical OR operations (V)- They appear negated with 
a certain probability. In the formula F, all clauses are 
connected by logical AND operations (/\) 



F 



Q 



so that all clauses C q should be simultaneously satisfied 
in order to satisfy the formula F. A particular formula- 
tion of the A:S problem is the A:-XOR-SAT (fcXS) problem 
[E IE 111 EH j m which each clause C q is a parity check of 
the kind 



C a 



mod 2 



(45) 



so that C q is TRUE if the total number of true vari- 
ables which define the clause is odd, while otherwise the 
clause C q is FALSE. It is straightforward to map the 
/cXS problem to our former model for the case odd val- 
ues of k. Actually, each clause C q corresponds to a k- 
cycle [Q = M] and each variable x v to a link Fur- 
thermore [B = L] with the correspondence Sij = 1 for 
x v = 1, while Si.j — — 1 for x v — 0. For the case of even 
values of k, one can use the same mapping but consider 
as clause C q in Eq. 145|) its negation C q . In this way, when 
the number of satisfied variables x\ is odd the clause C q 
is unsatisfied for odd values of k, while C q is satisfied for 
even values of k. 

Moreover a typical algorithm for finding a solution of the 
kS problem is the so-called Random- Walk SAT (RWS). 
The procedure is the following [a,|6|: select one unsatis- 
fied clause C q randomly, next invert one randomly chosen 
variable of its k variables x\» ; repeat this procedure un- 
til no unsatisfied clauses are left in the problem. Each 
update is counted as 1/B units of time. As one can 
easily see, this algorithm is very similar to our uncon- 
strained dynamics apart from two aspects. First, in our 
unconstrained dynamics we use the dynamical propen- 
sity parameter p, while it is absent in the RWS. Second, 
in our unconstrained dynamics we count also the choice 
of a balanced fc-cycle as update event, although it does 
not change the system at all. Because of this reason, 
the literal application of the original algorithm of uncon- 
strained dynamics has very high computational costs if it 
is applied to diluted networks. Apart from the parameter 
p, we can therefore use the same RWS algorithm for our 
unconstrained dynamics of fc-cycles. This algorithm is 
more reasonable because it selects at each update event 
only imbalanced fc-cycles which are actually the only ones 
that should be updated. In case of an all-to-all topology 
there are so many triads that a preordering according to 
the property of being balanced or not is too time con- 
suming so that in this case our former version is more 



13 



appropriate. In order to count the time as in our origi- 
nal framework of the unconstrained dynamics, we should 
impose that, at the n-th update event, the time increases 
as 



1 

L 



(46) 



Here a = M/L stands for the ratio of the total number of 
fc-cycles of the system (i.e. total number of clauses) and 
the total number of links (i.e. total number of variables). 
The parameter a is called the "dilution" parameter, it 

can take all possible values in the interval 0, m /L 



>-i) _ 



a" u ' — J2\=i M 2 i~i/L is the ratio of the total num- 
ber of imbalanccd (or "unsatisfied" ) fc-cycles over the to- 
tal number of links, in particular ai" is computed be- 
fore an instant of time at which the n-th update event 
is implemented. Therefore the ratio a/alT gives us 
the inverse of the probability for finding an imbalanced 
/c-cycle, out of all, balanced or imbalanced, A;-cycles, at 
the n-th update event. This is a good approximation to 
the time defined in the original unconstrained dynamics. 
It should be noticed that this algorithm works faster in 
units of this computational time, but the simulation time 
should be counted in the same units as defined for the 
unconstrained dynamics introduced in section HTl 
The usual performance of the RWS is fully determined by 
the dilution parameter a. For a < ad the RWS always 
finds a solution of the fcS problem within a time that 
scales linearly with the number of variables L. In partic- 
ular for the fcXS problem ad — 1/k. For aa < a < a c the 
RWS is still able to find a solution for the A:S problem, 
but the time needed to find the solution grows exponen- 
tially with the number of variables L. For the case of the 
3XS problem a c ~ 0.918. ad is the value of the dilution 
parameter for which we have the "dynamical" transition, 
depending on the dynamics of the algorithm while a c 
represents the transition between the SAT and the UN- 
SAT regions: for values of a > a c the RWS is no longer 
able to find any solution for the fcS problem, and in fact 
no such solution with zero frustration exists for the kS 
problem. Furthermore there is a third critical threshold 
a s , with ad < a s < a c . For values of a < a s all solutions 
of the kS problem found by the RWS are located into a 
large cluster of solutions and the averaged and normal- 
ized Hamming distance inside this cluster is (d) ~ 1/2. 
For a > a s the solutions space splits into a number of 
small clusters (that grows exponentially with the number 
of variables L) , for which the averaged and normalized 
Hamming distance inside each cluster is (d) ~ 0.14, while 
the averaged and normalized Hamming distance between 
two solutions lying in different clusters is still (d) ~ 1/2 
[To|. For the special case of the 3XS problem a s was 
found as a s ~ 0.818. 

In order to connect the problems of social balance on di- 
luted networks and the fcXS problem on a diluted system 
we shall first translate the parameters into each other. 
First of all we need to calculate the ratio a = M/L be- 



tween the total number of fc-cycles of the network and 
the total number of links L (section II V A|) . Next we 
consider the standard RWS applied to the fcXS prob- 
lem taking care of the right way of computing the time 
as it is given by the rule (|46|l and the introduction of 
the dynamical parameter p (section II V Bll . In particular 
we focus on the "dynamical" transition at ad (section 
IIV B 1|) and the transition in solution space concerning 
the clustering properties of the solutions at a s (section 
IIV B 2|) . The dynamical parameter p, formerly called the 
propensity parameter, leads to a critical value p c above 
which it is always possible to find a solution within a 
time that grows at most linearly with the system size 
( section llVB 3() . Finally, in section llV B 41 we decrease 
the dilution, i.e. increase a to a m such that for a > a m 
the system is fully described by the mean field equations 
of the former sections. We focus on the simplest case 
k = 3, but all results presented here for k — 3 should be 
qualitatively valid for any value of k > 3. 



A. Ratio a for random networks 

Let us first consider Erdos-Renyi networks ^2 as a 
diluted version of the all-to-all topology that we studied 
so far. An Erdos-Renyi network, or a random network, is 
a network in which each of the ( 2 ) different pairs of nodes 
is connected with probability w. The average number 
of links is simply (L) — w ( 2 ) . The average number of 
cycles of order k is given (M) — iu fc (^f), so that the 
average ratio (a) can be estimated as 



_ t 2N 



k-2 



k\ 



(47) 



In Figure |S] we plot the numerical results obtained for 
the ratio a as a function of the probability w, in the 
particular case of cycles of order k = 3. The reported re- 
sults, from bottom to top, have been obtained for values 
of N = 16, 32, 48, 64, 96, 128, 192 and 256. Each point is 
given by the average over 10 3 different network realiza- 
tions. In particular these numerical results fit very well 
with the expectations (full lines) of Ea. l(4Tjl . especially for 
large values of N and/or small values of w. Furthermore 
the critical values aa = 1/3 , a s = 0.818 and a c = 0.918 
(dotted lines) are used for extrapolating the numerical 
results of Wd (open circles), w s (open squares) and w c 
(gray squares) respectively [see the inset of Figure |8] • 
Wi , i = d, s, c is the value of the probability for which 
the ratio a, , i = d, s, c is satisfied. As expected, they 
follow the rule Wi = \JSai/N , i — d, s, c predicted by 
Eq.gZJ for k = 3. 

According to the isomorphism traced between the fcXS 
problem and the social balance for fc-cycles, from now 
on we will not make any distinction between the words 
problem and network, variable and link, fc-clause and k- 
cycle, value and sign (or spin), false and negative (or 
unfriendly), true and positive (or friendly), satisfied and 
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Figure 8: Numerical results (full dots) for the ratio a = M/L 
between the total number of cycles M of order k = 3 and 
the total number of links L as a function of the probability 
w for different sizes of Erdos-Renyi networks. In particular 
the numerical results refer to different network size N: from 
bottom to top N = 16, 32, 48, 64, 96, 128, 192 and 256. Each 
point is given by the average over 10 3 network realizations. 
The full lines are the predicted values given by Eg. (1471 . while 
the dotted lines denote the critical values ad — 1/3 , a s = 
0.818 and a c = 0.918 as described in detail in the text. In 
particular the numerical values of the probability w for which 
these three critical values of a are realized are denoted by 
Wd (open circles), w„ (open squares) and w c (gray squares) 
respectively, they are plotted in the inset, where the full lines 
are extrapolated by Eg. (1471 as Wi = s/SaT/N , i = d,s,c. 
The two upper curves for w s and w c almost coincide. 

balanced (or unfrustrated), unsatisfied and imbalanced 
(or frustrated), etc. . . . 

B. p- Random- Walk SAT 

So far we have established the connection between the 
fcXS problem and the social balance for fc-cycles, pro- 
posed in this paper. In particular we have determined 
how the dilution parameter a is related to diluted ran- 
dom networks parameterized by w. In this section we 
extend the known results for the standard RWS of 0, |(J 
to the p-Random-Walk SAT (pRWS) algorithm, that is 
the RWS algorithm extended by the dynamical parame- 
ter p that played the role of a propensity parameter in 
connection with the social balance problem. The steps 
of the pRWS are as follows: 

1. Select randomly a frustrated clause between all 
frustrated clauses. 

2. Instead of randomly inverting the value of one of 
its k variables, as for an update in the case of the 
RWS, apply the following procedure: 

• if the clause contains both true and false vari- 
ables, select with probability p one of its false 



variable, randomly chosen between all the 
false variables belonging to the clause, and flip 
it to the true value; 

• if the clause contains both true and false vari- 
ables, select with probability 1 — p one of its 
true variable, randomly chosen between all the 
true variables belonging to the clause, and flip 
it to the false value; 

• if the clause contains only false values (k 
should be odd), select with probability 1 one 
of its false variables, randomly chosen between 
all the false variables belonging to the clause, 
and flip it to the true value. 

3. Go back to point 1 until no unsatisfied clauses are 
present in the problem. 

The update rules of point 2 are the same used in the 
case of /c-cycle dynamics and illustrated in Figure ^ f° r 
the cases k = 4 (A) and k — 5 (B). For the special case 
of 3XS problem, the standard RWS algorithm and the 
pRWS algorithm coincides for the dynamical parameter 
P=l/3. 

1. Dynamical transition at ad 

The freezing time r, that is the time r needed for find- 
ing a solution of the problem, abruptly changes its be- 
havior at the dynamical critical point a<j = l/k. 
Figure reports the numerical estimate of the freezing 
time r as a function of the dilution parameter a and for 
different values of the dynamical parameter p [ p = (cir- 
cles) , p — 1/3 (squares) , p = 1/2 (diamonds) and p = 1 
(crosses) ]. As one can easily see, for p = 1/3 and p = 0, 
r drastically changes around ad, increasing abruptly for 
values of a > ad- For p — 1/2 and for p — 1 this drastic 
change is not observed. This is understandable from the 
fact that both values of p provide a bias towards par- 
adise, while p — 1/3 corresponds to a random selection 
of one of the three links of a triad as in the original RWS 
and p = would favor the approach to the hell if it were 
a balanced state. The simulations are performed over 
a system with L = 10 3 variables. Moreover each point 
stands for the average over 10 2 different networks and 
10 2 different realizations of the dynamics on such topolo- 
gies. At the beginning of each simulation the variables 
take the value 1 or with the same probability. The inset 
shows the relation between the time r* calculated using 
the standard RWS and the time r calculated according 
to Ea. l|46|l . The almost linear relation (the dashed line 
has a slope equal to one) between r* and r means that 
there is no qualitative change between the two different 
ways of counting the time. 

Following the same argument as in , we can specify 
for the update event at time t the variation of the number 
of unsatisfied clauses as 

AM t (u) = - (ka u (t) + 1) + ka s (t) = ka - 2ka u (t) - 1 , 
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Figure 9: Time r for reaching a solution for a system of L = 
1000 variables as a function of the ratio a and for different 
values of the dynamical parameter p [ p = (circles), p — 1/3 
(squares), p = 1/2 (diamonds) and p — 1 (crosses) ]. The 
pRWS performed for p — 1/3 shows a critical behavior around 
a s = 1/3: for values of a < a s , r grows almost linearly 
with a, while it jumps to an exponential growth with a for 
a > a s . The same is qualitatively true for p = 0, but the 
time r needed for reaching a solution increases more slowly 
with respect to the case p = 1/3 for a > a 3 . For p = 1/2 
and p = 1 there seems to be no drastic increment of r for 
a > a s . Moreover the inset shows the dependence of r*, the 
freezing time as calculated in the standard RWS 0, , on the 
freezing time r calculated according to Eq. l46ll . The almost 
linear dependence of r* on r (the dashed line has slope one) 
explains that there is no qualitative change if we describe the 
dynamical features of the system in terms of r or r* as time 
used by the simulations. 



because, by flipping one variable of an unsatisfied clause, 
all the other unsatisfied clauses which share the same 
variable become satisfied, while all the satisfied clauses 
containing that variable become unsatisfied. In the ther- 
modynamic limit L — ► oo, one can impose — 
La u (t). Moreover, the amount of time of one update 
event is given by Eq. (|4fc>p> so that we can write 



a u (t) = (ka - 2ka u (t) - 1) . 

a 

Ea. (|48|l has as stationary state (or a plateau) at 

ka — 1 
a ^^2k~ ■ 



(48) 



(49) 



Therefore, when the ratio a (that is the ratio of the num- 
ber of clauses over the number of variables) exceeds the 
critical "dynamical" value 



1 

k 



(50) 



the possibility of finding a solution for the problem dras- 
tically changes. This result was already found by . 
While for values of a < ad we can always find a solution 
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Figure 10: (Color online) Time behavior of the ratio ct u of 
unsatisfied clauses for different values of p [ A) p = , B) 
p = 1/3 , C) p = 1/2 , D) p = 1 ] and for different values of 
the dilution parameter a [ a = 0.3 (black, bottom) , a — 0.5 
(red, middle) , a — 0.85 (blue, top) ]. Numerical results 
of simulations [full lines] are compared with the numerical 
integration of Eq. l48H [dashed lines] leading to a very good 
fit in all cases, except for a — 0.85 and for p = 1/2 and 
p = 1. The initial configuration in all the cases is the one of 
an antagonistic society (a;, = , V i = 1, . . . , L), while the 
number of variables is L — 10 4 . 



because the plateau of Eq. I|49|l is always smaller or equal 
to zero, for a > ad the solution is reachable only if the 
system performs a fluctuation large enough to reach zero 
from the non-zero plateau of Eq. (|49() . In Figure EI] we 
report some numerical simulations for function of 

the time for different values ofp[A)p = 0,B)p=l/3 
, C) p = 1/2 , D) p = 1 ] and for different values of the 
dilution parameter a [ a — 0.3 (black, bottom) , a = 0.5 
(red, middle) , a = 0.85 (blue, top) ]. The numerical 
values [full lines] are compared with the numerical inte- 
gration of Eq. H48|) [dashed lines] . They fit very well apart 
from large values of t, for a = 0.85 and for p = 1/2 or 
p = 1. The initial configuration in all cases is that of an 
antagonistic society {xi — , V i = 1, . . . , L), while the 
number of variables is L — 10 4 . 



2. Clustering of solutions at a s 



In order to study the transition in the clustering struc- 
ture of solutions at a s , we numerically determine the 
Hamming distance between different solutions of the 
same problem. More precisely, given a problem of L vari- 
ables and M clauses, we find T solutions {x r i Y i Zi " "''i J of 
the given problem. This means that we start T times 
from a random initial configuration and at each time we 
perform a pRWS until we end up with a solution. We 
then compute the distance between these T solutions as 
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Figure 11: Normalized Hamming distance (d) [ Ea. l5H ] be- 
tween solutions as a function of the ratio a and different val- 
ues of the dynamical parameter p [ p — (circles) , p — 1/3 
(squares) , p = 1/2 (diamonds) and p = 1 (crosses)]. For 
the standard RWS (p = 1 /3) the distance drops down around 
the critical point a s . Different values of p perform not-really 
random walks and lead to effective values of a 3 smaller than 
the former one. The inset shows the dependence of (d) on the 
dynamical parameter p. As it is shown for different values of 
a [a = 0.3 (full line) , a = 0.5 (dotted line) and a = 0.85 
(dashed line)] the peak of the distance between solutions is 
for a pRWS which is really random, that is for p = 1/3. All 
the points here , in the main plot as well as in the inset, are 
obtained for a system of L — 20 variables. Each point is ob- 
tained averaging over 10 2 different networks and on each of 
these networks the average distance is calculated over 10 2 so- 
lutions. At the beginning of each simulation the value of one 
variable is chosen to be 1 or with equal probability. 
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The numerical results for L = 20 are reported in Fig- 
ure ^2 We average the distance over T = 10 2 trials 
and over 10 2 different problems for each value of a. As 
expected for p — 1/3 [squares] the distance between so- 
lutions drops down around a s (actually it drops down 
before a s because of the small number of variables). For 
different values of p [p = (circles) , p = 1/2 (diamonds) 
and p = 1 (crosses) ] , the pRWS is less random and (d) 
drops down before a s (or at least before the point at 
which the case p = 1/3 drops down). In particular, if 
we plot (as in the inset) the distance (d) as a function 
of p and for different values of a [a = 0.3 (full line) , 
a = 0.5 (dotted line) and a — 0.85 (dashed line)] we see 
a clear peak of the distance (d) around p = 1/3. This 
suggests that a completely random, unbiased RWS al- 
ways explores a large region in phase space, it leads to a 
larger variety of solutions. 



3. SAT /UN SAT transition at a c 

Differently from the general fcS problem, the fcXS prob- 
lem is known to be always solvable and the solution 
corresponds to one of the balanced configurations as de- 
scribed in section ITlI CI for the all-to-all topology. Nev- 
ertheless the challenge is whether the solutions can be 
found by a local random algorithm like RWS. In the ap- 
plication of the RWS it can happen that the algorithm is 
not able to find one of these solutions in a "finite" time, 
so that the problem is called "unsatisfied". The notion 
is made more precise in |10| . For practical reasons the 
way of estimating the critical point a c that separates the 
SAT from the UNSAT region is related to the so-called 
algorithm complexity of the RWS. Here we follow the 
prescription of 

H SE3 ■ Fixed k = 3 and calling a RWS 
with initial random assignment of the variables followed 
by 3L update events one trial, one needs a total number 
of trials T 3> (4/3) L for being "numerically" sure to be 
in the UNSAT region. In fact if after T trials no solution 
is found, the problem is considered as "unsatisfied" . 
The introduction of the dynamical parameter p can 
strongly "improve" the performance of RWS. Forp ^ 1/3 
the pRWS updates the variables following a well pre- 
scribed direction: the tendency is to increases the num- 
ber of negative variables for p < 1/3 and to decrease their 
number for p > 1/3. In particular, as we have seen in 
the former sections, for p > 1/2 the pRWS approaches 
the configuration of the paradise for the largest value of 
a = {i)/L 3> ol c and in a time that goes as r ~ L@ , so 
that there is no UNSAT region at all if we apply the for- 
mer criterion for the numerical estimate of the UNSAT 
region. Clearly, if the bias goes in the wrong direction, 
the performance gets worse. 

In this section we briefly give a qualitative description 
about the SAT/UNSAT region for the pRWS due to the 
dynamical parameter p. Let us define as + p c [~p c ] the 
minimum [maximum] value of p for which the system 
can be satisfied. Given a problem with aL clauses we 
follow the algorithm: 1) Set p = 1 [p = 0] ; 2) set an 
initial random configuration and apply the pRWS ; 3) 
if the pRWS finds the solution in a number of updates 
less than U ■ L , decrease [increase] p and go to point 2) 
; 4) if not + p c = p {~p c = p]. This procedure can be 
performed up to the desired sensitivity for the numerical 
estimate of + p c [~p c ] ■ The idea of defining an upper + p c 
and lower critical value ~p c for the dynamical parameter 
p is related to the fact that for p = 1/3 the pRWS has 
most trouble to find the solution. Figure IT2"l3 and Fig- 
ure I12C show the numerical results for + p c and ~p c as 
a function of the dilution parameter a. The number of 
variables is L = 10 3 . We report the results for different 
values of the waiting time T = L ■ U [ U = 1 (circles) , 
U = 2 (squares) , U — 3 (crosses) , U = 10 (crosses) ]. 
Each point is averaged over 10 different problems and 10 
different pRWS applied to each problem. Qualitatively 
it is seen that for a < otd the problem is always solvable 
( + p c — and ~p c = 1 ) , while for a > ad one needs 
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Figure 12: Numerical estimate of the upper + p c (B) and lower 
Pc (C) critical values of p [see the text for their definition] 
as a function of the dilution parameter a. Here L — 10 3 
and the different symbols corresponds to different maximum 
waiting times T = U ■ L [ U = 1 (circles) , U = 2 (squares) , 
U = 3 (diamonds) ,(7 = 10 (diamonds) ] . Each point is given 
by the average over 10 different problems for each value of a 
and 10 different pRWS for each problem (with random initial 
condition). Moreover in (A) we show the probability P that 
the pRWS finds a solution at a — 0.918 ~ a c as a function of 
p. We used different waiting times [ U — 1 (circles) , U — 2 
(squares) , U = 3 (diamonds) , {7 = 10 (crosses) , Z7 = 100 
(triangles) ]. See the text for further comments. 



p =/= 1/3 for solving the problem. Of course the numerical 
values for + p c and ~p c depend on the waiting time until 
the pRWS reaches a solution. Here, for simplicity we do 
not wait long enough for seeing a similar behavior around 
a c instead of ay. Furthermore, in Figure IT2t V we report 
the probability P, that is the ratio of success over the 
number of trials, for solving the problem as a function 
of p for a — a c . The waiting time is U = 1 (circles) , 
U = 2 (squares) , U = 3 (diamonds) , U = 10 (crosses) 
and U = 100 (triangles), respectively. The probabilities 
are calculated over 10 2 trials for each point (10 different 
problems times 10 pRWS for each problem). As the wait- 
ing time increases the upper critical value + p c for finding 
for sure the solution decreases ( + p c ~ 0.8 for {7 = 1, 
+p c ~ 0.7 for U = 2 , +p c ~ 0.6 for [7 = 3 and for U = 10 
, + p c ~ 0.5 for U = 100 ). This means that even for less 
biased search, solutions can be found, while ~p c is zero 
for the waiting time reported here, no value of p < p c 
leads to a solution. This is as expected. If the variables 
are almost all negative it is harder to find a solution of 
the problem (the paradise is a solution while the hell for 
k odd is not). 




Figure 13: Probability p r that one variable belongs to r 
clauses as function of the dilution parameter a. The sym- 
bols stand for numerical results obtained over 10 3 different 
realizations for L = 128 variables [ r = (black circles) , 
r = 1 (red squares) , r = 2 (blue diamonds) and r > 3 (vi- 
olet crosses) ]. The lines stand for analytical predictions of 
Eq.lEU [ r = (black full line) , r = 1 (red dotted line) , 
r — 2 (blue dashed line) and r > 3 (violet dotted-dashed line) 



4- Mean-field approximation down to a m 

By construction the "topology" of a fcS problem is 
completely random (for this reason is sometimes called 
explicitly as Random fc-SAT problem). Each of the L 
variables can appear in one of the aL clauses with prob- 
ability v — 4 + + . . . + j^rc- In particular for L ^> k 

one can simply write v ~ Then the probability P r 
that one variable belongs to r clauses can be described 
by the Poisson distribution 



Pr 



{ak) r 



(52) 



with mean value (r) = ak and variance a r = \fak. P r is 
plotted in Figure [P3l where the numerical results [ sym- 
bols , r = (black circles) , r = 1 (red squares) , r = 2 
(blue diamonds) and r > 3 (violet crosses) ] are com- 
pared to the analytical expectation [ lines , r = (black 
full line) , r = 1 (red dotted line) , r = 2 (blue dashed 
line) and r > 3 (violet dotted-dashed line) ]. 

If we start from an antagonistic society (all variables 
false) the minimum value of the dilution a m needed to 
reach the paradise (if p > 1 /2) is that all variables belong 
to at least one clause. This means that Pq < 1/L, from 
which 



InL 



(53) 



It is interesting to note that the same criterion applies for 
any p. In Figure El we plot the absolute value of the dif- 



ference I 



(I) 



Po 



I, between ^'Vooj the theoretical 



prediction for the stationary density of true variables, 
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Eg. (|14fl ] and the numerically measured value ' m Voo, as 
a function of the dilution parameter a. 



(m) 



is obtained 



as the average of the density of friendly links (registered 
after a waiting time T = 200.0 , so that is effectively 
the stationary density) over 50 different problems and 50 
different pRWS for each problem. The results reported 
here are for L = 128 (open symbols) and L = 256 (gray 
filled symbols) and for different values of p [ p = (cir- 
cles) , p = 1/3 (squares) , p — 1/2 (diamonds) , p = 1 
(triangles) ]. The initial conditions are those of an an- 
tagonistic society. The dashed lines are proportional to 
e~ 3a . Figure ITU shows that the mean- field approxima- 
tion of Ea. (|14f> becomes exponentially fast true as the 
system dilution decreases. Moreover, as for the cases 
p = and p = 1/3, we can observe that the difference 
| ^ Poo — ^' Poo | is always smaller than for p = 1/2 and 
p = 1. Qualitatively this means that the dilution a of 
the system needed to reach the theoretical expectation 
of Ea. l|14|l is smaller than a m for p < 1/2. In general we 
can say that a m is a function of p: a m = a m (p) , and a m 
is the minimum value of the dilution of the system for 
which we can effectively describe the diluted system as 
an all-to-all system for all the values of p. Moreover, it 
should be noticed that for a > a m almost all variables 
belong to at least three clauses [ see Figure EH ] • This 
fact allows the pRWS to explore a larger part of config- 
uration space. Let us assume that one variable belongs 
to less than three clauses: an eventual update event that 
flips this variable so that the one triad becomes balanced, 
can never increase the number of unsatisfied clauses by 
frustrating other clauses it belongs to. This reminds us 
to the situation in an energy landscape in which an al- 
gorithm gets stuck in a local minimum when it never 
accepts a change in the "wrong" direction, i.e. towards 
larger energy. 



V. SUMMARY AND CONCLUSIONS 

In the first part of this paper we generalized the triad 
dynamics of Antal et al. to a fc-cycle dynamics Q. Here 
we had to distinguish the cases of even values of k and 
odd values of k. For all values of integer k there is again 
a critical threshold at p c = 1/2 in the propensity pa- 
rameter. For odd k and p < p c the paradise can never 
be reached in the thermodynamic limit of infinite system 
size (as predicted by the mean field equations which we 
solved exactly for k = 5 and approximately for k > 5). 
In the finite volume, in principle one could reach a bal- 
anced state made out of two cliques (a special case of 
this configuration is the "paradise" when one clique is 
empty). However, the probability for reaching such type 
of frozen state decreases exponentially with the system 
size so that in practice the fluctuations never die out in 
the numerical simulations. For p > 1/2 the convergence 
time to reach the paradise grows logarithmically with 
the system size. At p = 1/2 paradise is reached within 
a time that follows a power law in the size N, where we 




Figure 14: Difference | {m> p x - { 'poo | between { 'poo the 
theoretical prediction for the stationary density of friendly 
variables [ Eg. 11411 ] and the numerically measured value 



O), 



as a function of the dilution parameter a. 



is obtained as the average of the density of friendly links (reg- 
istered after a waiting time T = 200.0 , so that is effectively 
stationary ) over 50 different problems and 50 different pRWS 
for each problem. The results displayed here are obtained for 
L — 128 (open symbols) and L = 256 (gray filled symbols) 
and for different values of p [p — (circles) , p — 1/3 (squares) 
, p = 1/2 (diamonds) , p = 1 (triangles) ]. The initial con- 
ditions are those of an antagonistic society. The dashed lines 
are proportional to e~ 3a . 



determined the fc-dependence of the exponent. In partic- 
ular, the densities of fc-cycles with j negative links, here 
evolved according to the rules of the fc-cycle dynamics, 
could be equally well obtained from a random dynamics 
in which each link is set equal to 1 with probability Poo 
or equal to — 1 with probability 1 — . This feature was 
already observed by Antal et al. for k = 3 1] . It means 
that the individual updating rules which seem to be "so- 
cially" motivated in locally reducing the social tensions 
by changing links to friendly ones, end up with random 
distributions of friendly links. The reason is a missing 
constraint of the type that the overall number of frus- 
trated fc-cycles should not increase in an update event. 
Such a constrained dynamics was studied by Antal et al. 
in p], but not in this paper. 

For even values of k, the only stable solutions are 
"heaven" (i.e. paradise) and "hell" for p > 1/2 and 
p < 1/2, respectively, and the time to reach these 
frozen configurations grows logarithmically with N. At 
p c = 1/2 other realizations of the frozen configurations 
are possible, in principle. However, they have negligi- 
ble probability as compared to heaven and hell. Here the 
time to reach these configurations increases quadratically 
in N, independently of k. This result was obtained in two 
ways. Either from the criterion to reach the stable state 
when a large enough fluctuation drops the system into 
this state (so we had to calculate how long one has to 
wait for such a big fluctuation) . Alternatively, the result 
could be read off from a mapping to a Markov process for 
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diploid organisms ending up in a genetic pool of either 
all "+"-genes or all "—"-genes. The difference in the pos- 
sible stable states of diploid organisms and ours consists 
in two-clique stable solutions that are admissible for the 
even fc-cycle dynamics, in principle, however such clique 
states have such a low probability of being realized that 
the difference is irrelevant. 

The difference in the exponent at p c and the stable con- 
figurations above and below p c between the even and odd 
fc-cycle dynamics was due to the fact that "hell", a state 
with all links negative as in an antagonistic society, is 
a balanced state for even k, not only by the frustration 
criterion of physici sts, but also according to the criterion 
of social scientists [llj . 

As a second natural generalization of the social balance 
dynamics of Antal et al. we considered a diluted network. 
One way of implementing the dilution is via a random 
Erdos-Renyi network, characterized by the probability w 
for connecting a randomly chosen pair of nodes. Here 
we focused our studies to the case k = 3. The mean- 
field description and the results about the phase struc- 
ture remain valid down to a certain degree of dilution, 
characterized by w m - This threshold for the validity of 
the mean-field description practically coincides with the 
criterion whether a single link belongs to at least three 
triads (for w > w m ) or not (w < w m ). If it does so, an up- 
date event can increase the number of frustrated triads. 
For w < w m , or more precisely w < Wd < w m it becomes 
easier to realize frozen configurations different from the 
paradise. Isolated links do not get updated at all and iso- 
lated triads can freeze to a "+"-"— "-configuration. The 
time to reach such a frozen configuration (in general dif- 
ferent from the paradise) grows then only linearly in the 
system size. Also the solution space, characterized by the 
average Hamming distance between solutions, has differ- 
ent features below and above another threshold, called 
w s with Wd < w s < w m . Therefore one of the main dif- 
ferences between the all-to-all and the sufficiently diluted 
topology are the frozen configurations. For the all-to-all 
case we observed the paradise above p c for odd values 
of k and even values of k and the hell for even values 
of k below p c , in the numerical simulations, because the 
probability to find a two-clique-frozen configuration was 
calculated to be negligibly small. For larger dilution, also 
other balanced configurations were numerically found, as 
mentioned above, and the time passed in the numerical 
simulations for finding these solutions followed the theo- 
retical predictions. 

In section IIVI we used, however, another parameteriza- 
tion in terms of the dilution parameter a, that was the 
ratio of triads (clauses) over the number of links [we gave 
anyway an approximated relation between a and w in 
Eq. (|47|l ] . The reason for using this parameterization was 
a mapping of the fc-cycle social balance of networks to a k- 
XOR-SAT (fcXS) problem, that is a typical satisfiability 
problem in optimization tasks. We also traced a mapping 
between the "social" dynamical rules and the Random- 



Walk SAT (RWS) algorithm, that is one approach for 
solving this problem in a random local way. As we have 
shown, the diluted version of the 3-cycle social dynam- 
ics with propensity parameter p — 1/3 corresponds to a 
3XS problem solved bythe RWS algorithm in its stan- 
dard form (as used in |E@)- 

The A:XS problem is always solvable like the fc-cycle so- 
cial balance, for which a two cliques solution always exists 
due to the structure theorem of > containing as a spe- 
cial solution the so-called paradise. The common chal- 
lenge, however, is to find this solution by a local stochas- 
tic algorithm. The driving force, shared by both sets of 
problems, is the reduction of frustration. The meaning 
of frustration depends on the context: for the fc-cycle 
dynamics it is meant in a social sense as a reduction of 
social tension, for the A:XS problem it corresponds to vi- 
olated clauses. The mathematical criterion is the same. 
The local stochastic algorithm works in a certain param- 
eter range, but outside this range it fails. The paradise 
is never reached for a propensity parameter p < 1/2, 
independently of k. Similarly, the solution of the kXS 
problem is never found if the dilution parameter is larger 
than a c , and the RWS algorithm needs an exponentially 
long time already for a > ad, with ad < a c . 
We generalized the RWS algorithm, usually chosen for 
solving the fc-SAT (fcS) problem as well as the kXS prob- 
lem, to include a parameter p that played formerly the 
role of the propensity parameter in the social dynamics 
(pRWS). The effect of this parameter is a bias towards 
the solution so that ad, the threshold between a linear 
and an exponential time for solving the problem, becomes 
a function of p. Problems for which the pRWS algorithm 
needed exponentially long for p = 1/3, now become solv- 
able within a time that grows less than logarithmically 
in the system size for p > 1/2 and less than power-like 
in the system size for p = 1/2. Along with the bias 
goes an exploration of solution space that has on average 
a smaller Hamming distance between different solutions 
than in the case of the |RWS algorithm that was for- 
merly considered [HOI- 

Our paper has illustrated that the reduction of frustra- 
tion may be the driving force in common to a number 
of dynamical systems. So far we were concerned about 
"artificial" systems like social systems and satisfiability 
problems. It would be interesting to search for natural 
networks whose evolution was determined by the goal of 
reducing the frustration, not necessarily to zero degree, 
but to a low degree at least. 
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